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ABSTRACT 

This Tiwo-part paper atterr;pts to establish the facts 
about, and to debate the rr.erits of, using individual earnings 
mf crmat lon collectea quarterly by states f ro^ employers as a source 
for vocational education perf crrrtance assessrrent. The first part of 
the paper explores three topics: (1) v;no wants to know about the 
earnings of vocat-Lonal education prograir. leavers and why do they wan 
to Knov;? (2) what protlerr.s are encountered m using other available 
data sources that are not found m working with wage-records data? 
and (3) w^nat specific data items does the quarterly v;age-re-"^'rci 
source offer? The secor.':^ part of the paper then examines process 
issues that are encountered m using the wage-reccrd data. Brief 
mention is rriade of complementary data sourC'3S that enhance tiie 
use: ulne .j^^- of the wage^record data. The pav er concludes that it is 
only a m-atter of time bef re the wage^record data are used and that 
procedure^ m«us^ b. worked cut for the most effective and efficient 
use cf tho data. A Il-item r 1 1 liocrrarhv is included, (KC) 
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Introduction 



Each State now collects individual earnings information direct- 
ly from most employers on a quarterly basis as a routine matter. 
Awareness of this fact has prompted many questions about the 
availability of these data and their usefulness for varied purposes. 
These questions, in turn, have created a sense of unease in many 
quarters. 

This paper represents an attempt to separate fact from fiction 
and to establish a common groimd for debating the merits of using 
this data source for vocational education performance assess- 
ment purposes (Northeast-Midwest Institute, 1989; David W. 
Stevens, 1989.) 

The first part of the paper explores three topics: 

(1) Who wants to know about the earnings of vocaiionaJ 
education program leavers, and why do they want to 
know? 

(2) What problems are encountered in using other avail- 
able data sources that are not found in working with wage- 
records data? 

(3) What specific data items does the quarterly wage- 
record source offer? 

The second part of the paper then examines process issues that 
are encoimtered in using the wage-record aata. Brief mention is 
made of complementary data sources that enhance the usefulness 
of the wage-record data. 



Parti 



Who Might Use V/age-Records 



Many possible users of individual earnings information for 
vocational education assessment purposes can be identified, in- 
cluding: 

(1) those who are responsible for decisions regarding con- 
tinued program funding; 

(2) those who are involved in new program approval 
decisions; 

(3) those who offer student counseling services; 

(4) those who must evaluate instruaional staff members; 
and, 

(5) those who are charged with administrative assessment 
responsibilities. 

A common denominator among these potential users of wage- 
records information is that the labor market experience of pre- 
vious enroUees is recommended as a basis for current decisions. 
Three technical issues are raised in this single sentence: 

(1) Which previous enroUees are we talking about - what 
is the appropriate unit of observation; 

(2) what time interval of labor market experience is con- 
sidered to be important; and, 

(3) how quickly must the information be retneved? 
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The Choice of a Unit of Analysis 

The answer that is given to the first of these questions deter- 
mines what assessment issues can and cannot be addressed (Klit- 
gaard and Hall, 1973.) Information about all who entered a 
vocational education activity includes individuals who stayed for 
different lengths of time, ocdy some of whom actually completed 
the prescribed course of study. Even among those who com- 
pleted the course of study, different competency levels will have 
been attained. And, among those with a uniform competency 
level at the time of exit from the vocational education activity, dif- 
ferent increments of value-added can actually be attributed to 
the vocational education activity itself— smdents enter the course 
of study with different initial competencies. 

For some oversight purposes group averages will offer suffi- 
deni information— such as for comparisons among postsecon- 
dary vocational courses (National Assessment of Vocational 
Education, 1988.) For other management uses "outliers" will be 
of greater interest —when an explanation for dismal or exemplary 
performance is sought. Averages shield from view important in- 
formation about unusually good or bad cases. These unusual 
cases may, in turn, offer usefiil information to administrators who 
want to promote positive outliers and avoid negative extremes. 

Analysis of transcript data demonstrates the imponance of 
choosing a useful defiiiition of vocational education; one that of- 
fers a high probability of public or administrative interest in 
reported outcomes. "Vocational education" outcomes are not 
actionable — no one has management responsibility for this broad 
generic activity. Postsecondary vocational education aaivities 
that receive Federal fimds have identifiable constituencies. A 
technology curriculum within a given Area Vocational Technical 
School impacts upon specific individuals. The unit of analysis 
that Is chosen must have an identifiable person or group who can 
aa upon the new information that will be available. 



Employment and earnings infonnation must be tied to careful- 
ly chosen units of analysis for at least two reasons: 

(1) confidentiality restrictions on the use of the data; and, 

(2) reliability for potential uses. 

In the case of State wage-records data the selection of units of 
analysis must be accomplished before the data are requested. 
One violation of established disclosure rules will bring the entire 
house-of-cards crashing down. Ways to assure compliance with 
these privacy requirements are known; and they are discussed in 
a later section of diis paper. Similarly, any revelation of accep- 
tance of an inappropriate reliability standid will jeopardize the 
entire accountability effort 

The message that emerges from this brief treatment of the 
'Vh/* question— who wants wage-records information about 
previous em^ollees in vocational education activities for what pur- 
poses—is that different parties want the information for varied 
purposes. This diversity of interests must be recognized in 
designing a practical approach for making the data available. 
Simultaneous satisfaction of both routine administrative and 
cost-effectiveness constraints requires careful prior planning. 
Otherwise, Arizona's ill-fated approach (MPR Associates, 1988) 
will be repeated. 

Given a desire for wage-records data, what time period should 
be covered? This question is addressed in the next section. 



The Time Interval to Be Covered 

The diversity of potential uses of the data assures that all ap- 
plications will not require the same time coverage. A willingness 
to accept point-in-time status as an interesting performance 
measure is rejected here (Carvell Education Management Plan- 
ning, Inc., 1984; Bishop, 1987; Stevens, 1987.) It is assumed that 
longitudinal employment and earnings information of some type 
is sought to complement or substitute for the point-in-time count 
of placements. 
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Among the most important reasons why the length of the ob- 
servation period is relevant are: 

(1) the impoiTance of site-specific and cyclical conditions 
diminishes through time; 

(2) complementarities between instimtional and on-the- 
job training can be expected to change with the passage of 
time; 

(3) job retention, occupational mobility, personal com- 
petitiveness, and subsequent enrollment in furthier educa- 
tion or militaiy service can only be traced as time elapses; 
and, 

(4) skill obsolescence and renewal panems can only be 
monitored through time. 

The appropriateness of the economist's production function 
concept— vocational education and other inputs jointly produce 
an applied competency output— has been dealt with elsewhere 
(Stevens, 1983). Whether schools should be held accountable 
only for value-added in the form of incremental competencies, 
without reference to the discretionary choice by the enrollee 
whether an attempt will be made subsequently to apply these 
skills in the workplace, or whether opportunities to do so are of- 
fered, is not addressed here. 

An expression of interest in the possible usefulness of State 
wage-records data is accepted as sufficient evidence that lon- 
gitudinal employment and earnings information is considered to 
be important for vocational education assessment purposes. An 
intention to rely on these data only (i.e., in conccn with the ex- 
clusion of all other information) is not necessary to proceed with 
an examination of the data charaaeristics. A consensus in sup- 
port of using wage-records data to empower vocational educa- 
tion constituencies must be built from the ground up, by 
dismissing myths and by establishing confidence in the accuracy, 
timeliness and relevance of the information, 



The time interval question can be split into three parts: 

(1) At what point should the monitoring begin; 

(2) is there a minimum time interval that must be 
monitored to acquire the desired information; and, 

(3) is there a maximum time interval beyond which the 
continued collection of informaticii is thought to be un- 
necessary? 

When Should Monitoring Begin? 

If the selection for and assignment process within vocational 
education are of interest, then preenroUment employment and 
earnings data will be sought If employment during vocational 
education enrollment is thought to affea subsequent outcomes, 
then this period must be monitored too. 

Is There a Minimum Time Interval That Must Be Covered? 

The answer to this question will vary depending upon the 
specific evaluation question that is posed. I; is difficult to imagine 
a hypothetical question that would be of oversight interest that 
could be satisfied by less than one year's post-exit data. 

Is There a Maximum Time Interval That Must Be Covered? 

Here too, the answer depends upon the range of uses to which 
the data are to be put. Job retention might reasonably be 
monitored for a shoncr period of time than skill obsolescence. 
Military service need not be traced very far into adulthood in most 
cases. Enrollment in postsecondary education is another matter, 
as adults of all ages return to acquire or renew skills in ever 



Page 7 



At© There Constraints on TTiese Choices of Coverage? 

Yes, there are constraints. The historical availability of State 
wage-records, military service information, and higher education 
data, is uneven. This is why advocacy for a uniform national ap- 
proach to data retention has beg^n (Northeast-Midwest In- 
stitute, r 9.) 



The Timeliness of Data Availability 

The issue here is: How soon after a labor market event occurs 
should this be recorded to inform the vocational education com- 
munity? The answer using wage-records information is between 
six and nine months. 

There are potential users of wage-records information who 
have legitimate reasons for being unable to wait six to nine 
months to receive information about labor market events. A 
vocational education administrator who has entered into a per- 
formance-based contract to provide occupational skill training 
serviceS-may be unwilling to wait six to nine months following an 
enroUee's exit from the program to receive word of that person's 
employment status and earnings. This reluctance can be 
countered by creative "phased" performance-based contract 
specifications. For example, many for-profit employment agen- 
cies base their fees on the number of days that a new hire remains 
in a job -such as asking for one percent of the total fee per day 
worked up to the TnarimiiTTi of 100 days. 

School boards, a State education department. State legislators, 
members of Congress, prospective students, and advisory board 
members, would each be expected to find data of six to nine 
months vintage quite satisfaaory for their purposes. 

A related question is; "How often should such mfcrmation be 
colleaed?" This is a moot issue in the case of wage-records data 
because they are colleaed on a quarterly basis. If a longer time 
interval is sufficient for some analytical purposes, these data can 
be aggregated into multiple-quaner periods (e.^., annual earn- 
ings or average job retention periods.) 



A more important matter for deciding upon the usefulness of 
the wage-records data source is whether the quarterly lime inter- 
val is too long for some oversight purposes. For uses other than 
fine-tuning of contractor relationships and for the actual ad- 
ministration of performance-based contracting it is difficult to 
imagine why anyone would want wage-records data £.ooner than 
six to nine months. 
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Why Now? 



Interest in the wage-records data source has grown in the past 
year for several reasons: 

(1) States have undertaken their own efforts to utilize 
these data. Florida continues to refine an approach that 
was begun in 1984 (Pfeiffer et aL, 1987; Pfeiffer, 1988; 
PfeiJffer, 1989). Arizona initiated an abortive one year ef- 
fort to use wage-records data in 1985 (Brown and Choy, 
1988). Missouri conducted a five-year study of a sample 
of 1981 graduates using wage-records data (Brandt et al., 
1987). Virginia completed a longitudinal study in 1988 
(Virginia Employment Commission, 1988). The Center 
for the Study of Human Resources at the University of 
Texas at Austin is exploring the possible use of wage- 
records data to evaluate vocational education programs in 
Texas. Interest has been expressed by administrators in 
Maryland and Vermont Other States are undoubtedly 
conducting similar studies that have not been brought to 
my attention. 

In all cases two reasons are given for adoption of the wage- 
records approach: 

(i) Follow-up surveys conducted by or on behalf of 
individual vocational education instimtions have been 
shown to often fall below acceptable standards of 
statistical re lability; and, 

(ii) the wage-rftcords offer a low-cost and reliable al- 
ternative to the traditional survey method. 

(2) To date the availability of wage-records data has been 
a matter of individual ad hoc approval by a State Employ- 
ment Security Agency in response to a research request. 
Now systematic reviews of procedures are underway (Nor- 
theast-Midwest Institute, 1989). 



The impetus for reviewing data release practices has come 
from Congressional mandates that require the use of the 
data for enforcement purposes in conjunction with 
Federal housing subsidies and food stamps eligibility 
determination, and from the research community's 
heightened awareness of the value of the information for 
analytical uses. 

(3) The Deficit Reduction Act of 1984 (P.L. 98-369, Sec- 
tion 1137) requires all States to coUert quarterly wage- 
records informatioiL This requirement took effect during 
the fourth quarter of 1988. 

While all of the States now comply with this Congressional 
mandate, three have chosen to use a different approach 
than the others. Massachusetts and New York collect the 
information through their revenue departments, and the 
data are not made available for administration of the State 
unemployment compensation program. Michigan col- 
lects the infonnation through the same auspices as the 
other States, but they too decline to use the data for un- 
employment compensation program purposes. Unneces- 
sary administrative costs that are being incurred as a result 
of what amounts to duplication of effort in these three 
States can be expected to generate legislative pressure to 
conform to the other States' practices. 

All of the other States currently collea the wage-records 
information on a quarterly basis through their State 
Employment Security Agency. Thirty-nine of them have 
been doing so for decades; many for fifty years. 

The primary strength of other available data sources is the 
breadth of issues that can be covered. Occupational detail, ex- 
pressions of satisfactiou or dissatisfaction with employment 
responsibilities, opinions about the usefulness of different 
aspects of the vocational education exposure, and other personal 
attimdes, can ail be recorded through the sur/ey method. 

The basic weaknesses of survey data collection are cost and 
questionable reliability (Bishop, 1989.) Historically, cost con- 
sciousness has often doomed the usefulness of the resulting sur- 
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vey data. The longitudinal integrity of survey data is also more 
susceptible to legislative whims and changes in administrative 
priorities than use of an existing administrative data source. In 
the past, educators have often been asked to conduct the follow- 
up surveys themselves, which places them in the imtenable posi- 
tion of being responsible for maintenance of quality control 
standards in the collection of informadon upon which they will 
then be ev?'uated. 

This is the context in which the use of wage-records must be 
considered. Two questions are of particular unportance: 

(1) Since the wage-records have been available in some 
States for decades, why hasn't more use been made of 
them before; and, 

(2) what has changed that suggests that accountability 
practices for vocational et;- ^tion ought to be revised? 

The answer to both questions is that Federal funding for voca- 
tional education creates a public right to be informed about the 
relative payoff to different types of investments in occupational 
skill enhancement This assertion is compelling even though the 
Federal government contributes only one our. of every ten dollars 
spent on vocational education in the United States (outside the 
workplace). 
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The Wage-Records Data Source 

Introduction 

The prospect of having a reliable administrative data source 
that is uniforraly available in aU the States is seemingly a strong 
argument against continuation of expensive surveys that are of 
questionable accuracy. Several cautions are cited here, and each 
is elaborated upon in later sections of the paper. 

First, the wage-records data are colleaed and maintained 
through State statutory authority. Each State maintains total 
control over its wage-records. Language foimd in Seaion 
l06.(b)(3)(C) of the Job Training Partnership Act, which relates 
to performance standards requirements, raises some doubt about 
Congressional interpretation of this autonomy: ''...cost effective 
methods for obtaining such data as is necessary to carry out this 
section, which, notwithstanding any other provision oflaw, may 
include access to earnings records..." (Hanna, 1989). 

Second, an either-or choice between a survey or wage-records 
approach is not required. At least major parts of the employment 
experience component can be accomplished through use of the 
wage-records, while other types of information are sought 
through the survey method. Precision of statistical estimates is 
presumed to be of less importance for such issues as student and 
employer satisfaction with each other and the extent to which 
competencies learned through vocational education auspices are 
actually applicable on the job. 

And third, occupational information not routinely available 
in the wage-records data source. For many oversight purposes it 
is not needed (e.g., earnings levels and profiles over time, job 
retention rates, continuity of employment within a single in- 
dustry, interindustry and geographic mobility patterns, multiple 
job holding, and periods of unemployment or withdrawal from 
the labor force.) However, occupational affiliation is often ap- 
pealed to as a traditional proxy for the relevance of the specific 
occupational skills that have been learned. 
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These cautions are set forth at the outset to reassure skeptics. 
The issues are recognized as being of crucial importance in decid- 
ing upon the merits of the wage-records data as a potential addi- 
tion to the administrative and consumer information that is 
currentiy available. 

The practical importance of State control, confidentiality 
provisions and absence of occupational specificity can only be un- 
derstood when each issue is placed in historical perspective. It is 
therefore necessaiy to step back in time to ask when, why and how 
wage-records data collection began in the United States. 



Background 

The Federal Unemployment Tax Act (FUTA) was passed in 
1937. This A« provided for a new Federal tax of 3.0 percent of 
a designated wage base. A 2.7 percent offset against this Federal 
tax was granted to States that complied with newly established 
Federal standards for administering an unemployment compen- 
sation program. 

This carrot was sufficient to entice all States to comply within 
a few years, so they would be eligible to use the 2.7 percent offset 
to pay individual unemployment compensation benefits. 

Reporting Requirements 

Administration of the newly enarted unemployment compen- 
sation programs required two actions by "covered" employers: 

(1) They were now required by lawto repon total covered 
earnings on a quarterly basis, so the apoiicable tax could 
be computed and assessed; and, 

(2) they were required to be able to document any in- 
dividual employee's earnings, so a determination of 
eligibility to receive uner iloyment compensation 
benefits could be made when nd if it became necessary 
to do so. 
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All covered employers in each of the States were reqiiired to 
comply with the first mandate by reporting directly to the desig- 
nated State Employment Security Agency within a specified time 
interval A "covered** employer is one that is liable to pay the un- 
employment compensation tax under the State's statute. 

The States differed in their approach to the second reporting 
requirement Many of the States adopted a procedure by which 
each covered employer was required to report each emi^oyee's 
quarterly earnings with an accompaz^g social security gumber 
as a unique identifier. This reporting requirement, coupled with 
the tax burden itself^ was not a welcome addition to the 
employers' responsibilities. Government intnisiveness was 
vigorously resisted 

Some States responded to employer opposition by adopting a 
w^ge request procedure, which contrasts with the wage reporting 
approach that was described above. The wage request procedure 
deferred collection of individual earnings information until it was 
needed to process an application for unemployment compensa- 
tion benefits. When such an application was filed, each base 
period employer identified by the applicant was contacted to 
verify the amoimt of covered earnings thaf would be ured in com- 
puting the benefit amount that would be paid 

The "base period** refers to the period of time during which 
previous earnings would be counted in computing benefit 
eligibility (usually the first four of the last five completed quaners 
prior to the claim filing date.) This wage request approach meant 
that individual earnings would never be recorded unless a claim 
to receive unemployment compensation benefits was filed. For 
our purposes, this means that longimdinal earnings records for 
individuals in these states would not be available for most 
workers, 'lliis is the optional procedure that the Deficit Reduc- 
tion Act of 1984 discouraged. Today, only Massachusetts. 
Michigan and New York continue to rely on wage request prac- 
tices because their State legislatures chose to comply with the re- 
quirement in a way that did not release the data to the State 
Employment Security Agency. 
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The collection of quarterly earnings information began at a 
time when government intrusiveness in the conduct of private 
sector business activities was more limited than it is today. The 
data were handled in paper copy form and all entries were 
manual , Today, the business community has become accustomed 
to government reporting requirements, and much of the report- 
ing occurs in electronic form. Nevertheless, there are stiil ways 
in which errors in reporting cm and do occur. 

Tax Liability (Revenue Quality Control) 

Five types of employer are defined for tax liability determina- 
tion purposes: 

(1) for-profit private seaor businesses; 

(2) nonprofit organizations; 

(3) govenmieni entities; 

(4) household workers; and, 

(5) agricultural employers. 

There are four ways in which a for-profit business becomes li- 
able: 

(1) payment of a specified amount of total payroll during 
a designated time period; 

(2) having employed someone for pay during a specified 
number of weeks over a designated time period; 

(3) by acquiring and conducting without interruption the 
business of another party; and, 

(4) by being liable under the Federal Unemployment Tax 
Act and employing a worker in the State. 

Currently, in Missouri for example, a total payroll of $1,500 in 
any calendar quarter dining the current or preceding calendar 



year is the threshold for ( 1) above (Missouri Division of Employ- 
ment Security, 1984.) Employment of a worker "for some por- 
tion of a day in each of 20 different weeks in either the current or 
preceding calendar year" is the threshold for haviig employed 
someone for pay during the designated inten^aL 

A government entity is liable without minimum payroll and 
weeks worked conditions. A nonprofit organization is liable if it 
employs four or more workers for some portion of a day in each 
of 20 different weeks in either the current or preceding yeai . 
Agricultural employers are liable if diey employ 10 or more 
workers in 20 different . ,*cks during a year, or if they pay 520,000 
in cash w.iges in a quarter, both conditions applying to cumula- 
tive employment m all States. Employers of household workers 
become liable when they pay $1,000 in cash wages during a 
quarter during either the current or preceding year. 

Once liability is incurred, an employer remains liable until ter- 
mination of liability occurs. Termination of liability is based on 
the absence of the previously stated liability criteria during the 
preceding year. Requests for termination are made at the begin- 
ning of a year. 

The specified payroll and employment thresholds are not 
uniform across the States, but the criteria stated here for Missouri 
typify the other States' requirements. (Comparison of State Un- 
employment Insiu^ce Laws, 1988.) 

Since the origin of the wage-records, data is compliance with 
tax liability, any action to evade tax liability will introduce error 
into the wage-records data. Electronic cross-matching practices 
in the States continue to reduce the incidence of tax evasion. The 
Unemployment Insurance Service in the Employment and Trai'- 
ing Administration of the U.S. Department of Labor has recent- 
ly initiated a Revenue Quality Control program, and the Office 
of Strategic Planning and Policy Development in the Employ- 
ment and Training Administration has contracted with Abt As- 
sociates, Inc. to conduct research on this topic. A Benefit Qualir/ 
Control program has been in place for several years, and an 
evaluation of this program was recently completed (WESTAT, 
1989.) 
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Covered Employment 

A generic ciefinition of covered employment is any services that 
have been performed for remuneration under contrao. Pan- 
time, temporary and casual employment is covered. So arc cor- 
porate officers and stockholders who perform paid services, and 
agents and commissioned employees. 

Excluded Employment 

The services of direct sellers of consumer products who are not 
abated with a fixed retail establishment (i.e^ independent con- 
tractors); licensed real estate sales agents who receive a specified 
threshold of their compensation from direct sales; family mem- 
bers working for each other under specified circumstances; 
various types of employment for religious organizations; employ- 
ment in specific sheltered circumstances; and services performed 
by an enrolled student for a nonprofit school, typify what amounts 
to a list of special exclusions from tax liability. Railway employees 
are covered under separate Federal legislation. Military service 
is not covered. Self-employed persons are not required lo elect 
tax liability and coverage. Any organization or individual can 
voluntarily elert to be liable. 

A summary statement about the combined employer and 
employee coverage criteria is that approximately ninety-seven 
percent of civilian employment is covered. 

Reportable Compensation 

Reportable compensation includes both cash payments and the 
cash value of other considerations, such as food and shelter, which 
are paid for personal services. Bonuses, commissions, vacation 
and holiday pay, and termination pay are reportable. Tips that 
must be reported under the Federal Unemployment Tax Act are 
considered to be reportable. Retirement, sickness and disability 
(other than under Workers' Compensation Law) payments are 
reportable. Payments into an annuity fund that are exempt under 
Federal tax codes are not reportable. 
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Total reportable compensation is reported, even though there 
is a ceiling level beyond which tax liability is not incurred. It is a 
myth that only taxable wages are reported. 



A Brief Synopsis of the Wage-Records Data Source 

The Federal Unemployment Tax Act is now more than fifty 
years old. During the ensiling half century many changes have oc- 
curred in the State unemployment compensation systems. 
Coverage has been extended. Reporting procedures have been 
automated in many cases. Cross-matching procedures have been 
introduced to identify new business entities. Interstate coopera- 
tion has been established in response to the increasing incidence 
of interstate mobility. Wagenrecords reporting practices have 
come a long way. Having said this, a host of technical and proce- 
dural hurdles remain ahead before routine use of these data can 
be expected. The next section explores the major technical is- 
sues, which are: accuracy, timeliness and availability. 
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Technical Issues 



Accuracy 

The following accuracy concerns warrant attention hers: 

(1) employer reporting of a covered employee's presence; 

(2) employer reporting of the employee's money wages 
received; and, 

(3) employer reporting of the employee's nonwage com- 
pensation received. 

Employee Presence 

Each employer who is required to report does so using either 
a paper or electronic version of a Contribution and Wage Report. 
For our purposes the crucial parts of this reporting form are: 

(1) the employer account number; and, 

(2) the employee's social security number. 

The employer identification number contains fourteen digits. 
The first six digits constitute a unique employer account code. 
The seventh digit is changed when business ownership is trans- 
ferred and the first six digit account code is conveyed to a succes- 
sor. The next three digits indicate the Federal Information 
Processing System (FIPS) code that identifies the location of the 
reponmg unit. The final four digits are the Standard IndustriaJ 
Qassification (SIC) code that has been given to this reporting 
unit. 

Liable businesses that have more than one establishment in a 
State may, but not must, request a separate employer accouni 



code for each establishment. When they do not do so th^ ~IPS 
code is an inaccurate identifier of the worksite location, iviulti- 
establishment reporting practices currently affect different num- 
bers of covered workers in each State, because of the unique size 
and o^ -tr. . ship characteristics of businesses located in any State. 

The multi-establishment reporting practice is likely to change 
as States cooperate with the Bureu of Labor Statistics to create 
its Business Establishment List Earlier this year the Bureau of 
Labor Statistics was designated by the OfSce of Management ^ind 
Budget as the single Federal agency that is responsible for an ac- 
curate accounting for nonagricultural business entities. The 
Bureau is currently working with each of the States to create a 
routine procedure for them to report accurate establishment- 
based data (Plewes, 1988). One way for a State to comply is to 
reqtiire establishment-based reporting at the outset. Another 
way to comply, which has been used by many States in the past, is 
to disaggregate total reporting unit employment into estab- 
lishment shares without actually identifying the individuals who 
are located at the respective locations. 

The Standard Industrial Cassification code is assigned to the 
reporting unit This code is assigned at the time the business first 
becomes liable and it is subsequently reviewed on a three-year 
cycle. The accuracy of this code depends upon the initial descrip- 
tion of business activities that is given to the State Employment 
Security Agency; the interpretation that is given '.o this descrip- 
tion by the Agency employee who assigns the code; and the 
repetition of these two activities during each three-year review 
of the continuing appropriateness of the designation. 

Since a single Standard Industrial Qassification code is as- 
signed to a reporting unit, it must represent all of the covered 
employees in the unit The bakery industry has been cited as an 
example of the interpretive problem that might arise (Cohen, 
1989): Employees involved in the baking process are in the food 
industry. Those who distribute the bread to retail sales locations 
are engaged in wholesale trade. And those who handle the baked 
goods in the stores are employed in retail trade. 



The unique six digit employer account code is State specitlc. 
The seventh digit permits tracing of ownership between succes- 
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sors and predecessors. Therefore, an individual can be linked to 
a specific employer unit even when ownership changes. 
However, note has been taken of the fact that interstate move- 
ment within a single employer's jurisdiction cannot be traced 
using this State designation (Hanna, 1989); each State assigns its 
own code to the business' activities within its boundaries. Use of 
an employiLj unit's Federal Identification Nunber, which is 
uniform across all States, would resolve this potential problem. 

There are other ways in which the employer unit may be some- 
thing other than the actual location where the employee works. 
A Federal Conunon Paymaster Plan was established to ease the 
reporting burden in unusual circumstances such as longshore as- 
signments, some construction work, and the increasingly impor- 
tant temporary help service agencies. States also permit 
employers to request a joint account for common tax rate deter- 
mination ptirposes. (Experience rating practices in the states 
create varied incentives to form pools of covered employees, and 
in some cases to dissolve business entities to avoid triggering of 
higher tax rates. These practices increase the difficulty of inter- 
preting the sequence of employer unit codes that might be 
revealed by tracing an individual through a series of identifica- 
tion numbers.) 

The message here is that the surface appearance of a unique 
employer identification code soon dissolves into a complex list of 
possibilities. However, diligence in identifying the full range of 
possibilities in each of the States can be translated into agreed 
upon ways to interpret given circumstances. Automated diagnos- 
tics to accomplish these tasks have been developed by those who 
have worked with wage-records data in the past (Cohen, 1989; 
Crosslin, Hanna and Stevens, 1986). 

Up to this point, the "presence" issue has been addressed from 
the standpoint of the place of employment— can we tell where it 
is, who owns it, and what industry affiliation should be attached 
to it? 

The answer to the where question is: We can usually tell where 
an individual is employed, and we are improving on our ability to 
a.ssign the multi-establishment cases in an appropriate maimer. 



The answer to the ownership question is: We can always iden- 
tify ownership at ? point in time and changes in ownership that 
occur, but interpretation of these changes in ownership requires 
information beyond the wage-records reporting system. 

And the answer to the industry afGliation question is: A single 
four-digit Standard Industrial Qassification code represents 
each covered employee in an employer unit, so the diversity of 
productive activities found within this designation determines the 
appropriateness of the single industrial affiliation code. 

Another side of the •*prescnce'* issue is the accurate identifica- 
tion of a specific covered employee. The nine-digit social 
security number is the unique identifier that is assigned to each 
covered worker. Errors in re-wrding this number bar the detec- 
tion of the individual's presence. All is not lost, however. Al- 
gorithms have been developed to detect transposed digits in 
sequential quarterly wage-reports (Cohen, 1989). 

Since the social security number is the identifier that is used for 
Federal tax reporting purposes, some individuals attempt to 
evade the requirement that they reveal their own unique code. 
Cases have been encountered in Florida's use of wage-records 
for followup evaluation purposes in which students used their 
parents or friends ntmibers, or made up fictious numbers, for 
school records purposes (Pfeiffer, 1987). All dependent children 
who are reported for Federal tax purposes are now required to 
have social security numbers. This should increase the accuracy 
of reporting in the future, although the incentives for tax 
avoidance will still be present 

There is reason to be optimistic about our future ability to link 
a given covered employee with all places of employment. 

Money Wages Paid 

Excepting "off the books" compensation, money wages are 
reported with steadily improving accuracy as electronic reponing 
practices eliminate potential sources of human error and increase 
the probability of cross-matching for auditing purposes. 
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Since wages constitute the basis for both tax liability, and for a 
monetary determination of unemployment compensation benefit 
qualification, both the employer and the employee have a mutual 
interest in accuraqr. Intentional underreporting of wages paid 
constitutes fraud, which is subject to appropriate penalties. 
Unintentional missreporting is subject to penalty payments. Er- 
rors are most liicely to be detected when a claim to receive un- 
employment compensation bene£ts is filed, and base period 
earnings are retrieved to determine monetary qualification. 

liitentioiml missreporting obviously distorts covered earnings 
in a downward direction, since overreporting could create a 
higher tax liability. Unintentional missreporting should not 
reveal any pattern. 

The iniportance of erroneoub * ^norting of money wages paid 
depends upon the unit of analysis that is choseiL If the incidence 
of *'o£f the books" payment is unusually high in a particular oc- 
cupation or industry, then the wage-records source of informa- 
tion .'.'ill be weakened accordingly. This distortion is most lixely 
to occur with respect to nonwage reportable compensation. 

Nonwage Reportable Compensation 

Federal tax law now requires the reporting of tips, commis- 
sions, bonuses, and a reasonable valuation of in-kind payments. 
Anecdotal evidence suggests that compliance with this require- 
ment is uneven. To the extent that such payments are an impor- 
tant part of total compensation for partiailar occupations this 
diminishes the accuracy of the wage-reports data source. 



Timeliness of Reporting 

Liable employer units are required to report covered wage pay- 
ments for a given quarter within one month of the end of that 
quarter. Extensions of this time limit can be requested. Both in- 
terest and penalty fees can be assessed for late payments of taxes 
due. 
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State Employment Security Agencies mail contribution and 
wage report forms to liable smployen near the end of each 
quarter. The accuracy of this mailing depends upon cooperative 
agreements that have been established with other state agencies 
that become aware of new business enterprises. The detection of 
failures to report depends upon the enforcement resources that 
are devoted to this task by the State Employment Security Agen- 
cies. 

There is a size-bias in the timeliness of reporting. The largest 
employer units report electronically as a routine matter. Inter- 
mediate size units maintain personnel ofGces that are prepared 
to comply with the quarterly requirement, or they retain an ac- 
cotmting agent to perform payroll tasks. Small businesses are less 
likely to have access to these specialized staff resources, so late 
reporting involving a higher error rate is more likely to occur. 

Hmely reporting of tax liability and individual reportable com- 
pensation is a routine part of doing business for most liable 
employers. There is certainly a lower incidence of nonreporting 
and erroneous reporting through this source than there is through 
self-reporting survey approaches to securing the same informa- 
tion. 



Availability of the Wage-Records Data 

Assume that the reportible compensation information has 
been submitted in an accurate and timely manner in accordance 
with the applicable state law. Will this information be made avail- 
able to external parties; and, if so, when? 

Each State stamte includes a confidentiality provision that 
protects the anonymity of both the reporting employer unit and 
the individual employee. These stamtes were enaaed in the 
1930's in most cases, following the examples of predecessors that 
had moved quickly. The State Employment Security Agencies 
had one objective in mind at that time — to conduct a newly con- 
stimted unemployment compensation program. Promises of 
confidentiality were offered to reassure both employers and 
employees thai the information would be used only for un- 
employment compensation program purposes. Among employer 
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concerns from the beginning was a fear that unions would use in- 
formation about layoff patterns and wages in their negotiations 
with liable employers. 

As computer processing capabilities have matured, both 
employers and employees have expressed serious reservations 
about CTOSS-matchkig practices that combine two or more data 
sources. Recent Congressional actions mandating use of the 
wage-records data to enforcement purposes in Federal housing 
and food stamps programs have heightened these concerns. In a 
recert forum on the feasibility of creating a national wage- 
records archive this concern overshadowed ai^ of the technical 
issues that were discussed (Northeast-Midwest Institute, 1989.) 

Historically, ad hoc requests for wage-records data have often 
been satisfied As aggressive Federal movement into vocational 
education and other employment and training Lnitiative& oc- 
curred in the 1960s and 197(^ growing demands for such arran- 
gements were heard. To my knowledge the late Michael Borus 
was the first person to use wage-records data for evaluation pur- 
poses, in his Yale University PhJD. dissertation submitted in the 
mid-1960s. Since that time, I have used wage-records informa- 
tion &om Florida, Maryland, Missouri, Nevada, Oregon, Pennsyl- 
vania, South Carolina and Washington in various evaluation 
applications. 

For seven years, from 1977 to 1983, fourteen State Employ- 
ment Security Agencies participated in the Continuous Wage and 
Benefit History (CWBH) program of the Unemployment In- 
surance Service, Employment and Training Administration, U.S. 
Departmert of Labor (Hanna, 1989). 

Through these auspices a sample of covered workers was iden- 
tified in each of the cooperating States. Thereafter, quarterly up- 
dates were performed to create and maintain a continuous 
longitudinal record of reported employment and earnings for 
these sample members. 

For those who filed claims to receive unemployment compen- 
sation b>:nefits, claims information was added to th^-se files. 
Federal suppon for maintenance of these longitudinal records 



ended in 1983. Since that time the individual cooperating States 
have followed varied practices. 

Robert Crosslin, through the Center for Labor Market Infor- 
mation Systems Research at the University of Maryland-Bal- 
timore County Campus, and in cooperation with the National 
Commission for Employment Policy, is updating these State lon- 
gitudinal files. Crosslin and I recently completed an analysis for 
the 0£Gce of Foreign Economic Research in the International 
Labor AfEain Bureau of the U.S. Department of Labor using 
wage-records for the sample members from Missouri, Pennsyl- 
vania and South Carolina, who had been employed in one of seven 
manufacturing industries affected by international competition 
during the 1970s and early 1980$ (Crosslin and Stevens, 1988). 

Ad hoc availability has been good to date. Despite severe 
budget cuts the State Employment Security Agency ad- 
ministrators have been extremely cooperative in supporting the 
research interests of external parties. Having said this, there are 
several reasons to be concerned about the dependability of this 
cooperative attitude in the future: 

(1) As awareness of the usefulness of the data grows, the 
requests build too. Administrators will then be forced to 
either say yes or no to all comers. At some point they will 
be forced to say no; 

(2) as the user group grows the likelihood that someone 
will "mess up** increases. One instance of misuse of the 
data will threaten the entire fragile agreement; and, 

(3) as persoimel in State Employment Security Agencies 
turnover, standing agreements may fall by the wayside. 

Currently, when wage-records information is made available, 
a six to nine months time lag is experienced. First quarter infor- 
mation, for January through March, must be submitted by 
employers by April 30tb. These data must then be entered into 
the Agency's own operating system. My experience has been that 
the data would become available in July, which is six months from 
the time the relevant quarter began. The speed of response is 
contingent upon what is requested, too. I request a ''dump" of 
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the desired wage record information, which is the easiest request 
to satisfy. Requests for selcrted information items, or those that 
require iSle merging within the Agency, impose a greater burden 
on the Agency and usually take longer or result in a denial of the 
request 

To date, availability has been a matter personal working 
relationships. State Employment Security i ^encies are not re- 
quired to make the wage-records information available. Increas- 
ing numbers of requests have heightened concerns. 



Coverage 

For vocational education assessment purposes coverage is as 
comprehensive as one could reasonably hope for. There are 
minor differences among the States in the threshold criteria for 
tax liability and reporting, but these are of little consequence for 
virtually all possible assessment appUcations (Comparison of 
State Unemployment Insurance Laws, 1988). 

Noncoverage of some agricultural workers, employees in some 
family enterprises, the self-employed, employees of some 
religious organizations, railway workers, and indersndent con- 
tractors, will be of legitimate concern in imusual cases. This is 
one important reason why hasty action to mandate sole reliance 
on wage-records information for follow-up purposes would be a 
tragic mistake. Instead, careful thought should be given at the 
outset to creative ways in which the interests of those who cannot 
be satisfied through the wage-records information can be met. 

Two other technical issues warrant treatment here: 

(1) interstate comparability; and, 

(2) longitudinal integrity of the daui. 
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Interstate Comparability of the Data 

Each State's unemployment compensation stamte defines its 
eligibility criteria and applicable rules. Each State has its own 
personnel practices and data processing arrangements. The rela- 
tive strength, of the Agency's constituencies varies among the 
States, and the respective laws reflect these differences. Never- 
theless, the Federal Unemployment Tax Act is the guiding force 
with which all must comply. 

There have been Federal efforts to achieve substantial levels 
of uniformity among the States. Until 1987 the U.S. Department 
of Labor had supported an Employment Security Systems In- 
stimte (ESSI) in cooperation with the Kansas Employment 
Security Agency. Now cooperating State Employment Security 
Agencies voluntarily contribute to the maintenance of this at- 
tempt to shar&<^rtise. 

Actually, achievement of uniformity in reporting practices 
among the States is aa unwise goal to pursue. First, it is unneces- 
sary because differences can be handled by an external analyst. 
And second, pursuit of national uniformity amounts to the waving 
of a red flag in front of the States rights bull. 

With the exception of the unknown current status of Mas-" 
sachusett^. Ivlichigan and New York, there is no reason why each 
State Employment Security Agency cannot make its wage- 
records information available under suitable circumstances. 



Longitudinal Integrity of Wage-Records Information 

States follow different practices in the purging of the wage- 
records data they keep active for administration of their un- 
employment compensation programs. Most maintain active files 
for only the five quarters that are required to determine base 
period earnings when covered workers file claims to receive un- 
employment compensation benefits. They then retain older 
quanerly wage-iecord data lq varied forms for different periods 
of time. 



Page 29 



For vocational education assessment purposes it should be as- 
sumed that the wage-records data would be made available for 
future quarters only. Some historical information will be avail- 
able, but it cannot be counted on uniformly across the States. 



The Units of Analysis Issue 



Earlier it was stated that decisions about potential uses of the 
information have to be made before data requests are submitted. 
The reason that was given is that foolproof confidentiality as- 
surances must be offered. This requires that careful prior thought 
be given to what can and cannot be done with the information. 

For example, Cohen dtes the possibility tnat one user would 
request earnings information about employees in a particular in- 
dustry without respect to occupation. A totally independent re- 
quest could then be made for earnings infonnation about specific 
occupations without respect to industiy. These seemingly inde- 
pendent requests that comply with confidentiality standards 
might then be combined in violation of the standard (Cohen, 
1989). Such possibiUties have to be anticipated and safeguards 
built into the public use availability of the data. 

Current State employment security statutes usually permit a 
reporting employer unit to waive its right to confidentiality, so in 
principle it may be possible to secure individual waivers from 
employers whose identity is important for analytical purposes. It 
would still be necessary to assure the State agency that individual 
employee privacy would be respected. 

It is likely that employer cooperation can be gained for follow- 
up uses of wage-records information by appealing to their selfish 
interest in supporting cost-effective public services. Rapidly 
growing State commitments to industry-specific training sub- 
sidies, offered to retrain incumbent employees in resident com- 
panies, provide a window of opportunity to seek a reciprocal 
commitment by employers to support gaining of access to ad- 
ministrative information that is already collected for other pur- 
poses. 
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So, what unit of observation really is needed for assessment 
purposes? The possibilities, from small to large, are: 

(1) an individual enrollee; 

(2) a subgroup of enrollees (e.g., the female members of 
a class); 

(3) a class-size group of enrollees; 

(4) enrollees in a designated sequence of courses; 

(5) enrollees in a designated combination of course se- 
quences; 

(6) combinations of (2) through (5) across instimtions; 

(7) combinations of institutions within a designated 
geographic area; and, 

(8) combinations of geographic areas. 

When most observers talk about vocational education assess- 
ment they think in terms of (6), (7) and (8) above. These repre- 
sent a low risk of inappropriate disclosure. 
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Precedents for Assessment Uses of 
Wage-Records Information 

There is a current precedent under Job Training Partnership 
Act auspices for assessment applications of the wage-records 
data. The National Commission for Employment Folicy has 
awarded contracts to selected States (including Florida, Idaho, Il- 
linois, Indiana, Missouri, Nevada, Oregon, South Carolina, Utah, 
Virginia and Washington) to test the feasibility of using wage- 
records data for longitudinal foUowup purposes. The Center for 
Governmental Studies at Northern Illinois University is acting as 
a clearinghouse for this project None of the States have ex- 
pressed serious difBcuity in meeting the reporting requirements 
of this project, although timely submission of required data has 
been a burden in what is seen in some of the States as a one-time 
research activity with insufficient funding. Substantial 
demographic and JTPA activity detail is included, but no threat 
to privacy guarantees will be encountered. 

The Division of Job Development and Training, which is the 
Governor's administrative entity for conducting Job Training 
Parmcrship Act activities in Missouri, has contraaed with the 
University of Missouri-Columbia to conduct follow-up assess- 
ment studies using wage-records data provided by the Division 
of Employment Security. The most recent report submitted to 
the Division of Job Development and Training describes Service 
Delivery Area specific outcomes of JTPA activities (Division of 
Job Development and T rainin g, 1989). 

Previously, under National Governors' Association and Na- 
tional Occupational Information Coordinating Committee spon- 
sorship, I matched third quarter wage-records for all covered 
employees in Missouri in 1982 and each subsequent year. 
Reports v/ere produced indicating "stayer", "leaver", 'entry" and 
"exit" rates by two-digit Standard Industrial Classification code 
and separately by county. Examples were also giver of combina- 
tions of industry and geographic detail. I have continued to up- 
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date this file, and now have third-squarter records for all 
employed individuals in Missouri for 1982-1987 (Human 
Resource Data Systems, Inc^ 1984). 

These few examples indicate what can be done without violat- 
ing the confidentiality protections established by the States. 
However, before a larger organized effon is made to use these 
data, routine safeguards must be assured (Northeast-Midwest In- 
stimte, 1989.) 



Who Might Oppose Use of 
Wage-Records Information? 



Wage-records infonnatioii offen a low cost and dependable 
source of information about total compensation, industrial af- 
filiation, employer attachment and geographic location of 
employment This information can be linked with complemen- 
tary information about military service, higher education enroll- 
ment, and participation in transfer payment programs. 

Why, in the face of such comprehensive coverage, would 
anyone oppose the full development of this data source? The 
answer is: Because spedfic individuals and groups fear the un- 
known consequences of this new approach to accoimtability. 

The most obvious party who is threatened is anyone who cur- 
rently relies on survey-based follow-up methods that arc known 
to produce an inaccurate understanding of program outcomes. 
The wage-records approach takes control of the followup activity 
out of the hands of the educators. It is unreasonable to expect 
these parties at the local and State levels to voluntarily relinquish 
this control. 

Some State Emplo>'ment Security Agency and Federal Un- 
employment Insurance Service administrators express concern 
that a rush to use the wage-records for poUcy analysis and evalua- 
tion purposes endangers the superior administrative use of the 
data (Northeast-Midwest Instimte, 1989). Understandable con- 
cern is also expressed about what source of Federal funds would 
be tapped to suppon these new activities. 

One way to respond to these fears is to introduce the wage- 
records information as one routinely available data source that is 
neither mandated nor given priority over other types of account- 
ability. Some Congressional interest has been shown in sponsor- 
ing legislation to develop a national capacity to use the 
wage-records data for policy analysis purposes. If this approach 
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is taken, then the wage-records data would have to stand on their 
own merits. Local and State vocational educators, governors and 
legislators would be infonned about the availability of the wage- 
records information, but they would not be required to use it. The 
experience with perform^ce standards requirements under the 
Job Training Partnership Act is informative in this regard (King, 
1987; National Commission for Employment Policy, 1988; Office 
of Technology Assessment, 1989). 
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Performance Standards Practices 



King (1987) dtes the following conceptual criticisms of JTPA 
performance standard practices: 

(1) too numbers focused; 

(2) promotes creaming from eligible pool; and, 

(3) inadequate control of local program operator design 
options. 

The same concerns can be expected to emerge within the voca- 
tional education community (Office of Technology Assessment, 
1989). The following message should be conveyed: Good 
managers use reliable information that is inexpensive to obtain 
to guide decisions about the distribution of available resources in 
pursuit of their organizational goals. 

King notes four t^-chnical criticisms as well: 

(1) weak explanatory power of the models that are es- 
timated to establish performance standards; 

(2) economic data limitations; 

(3) participant data limitations; and, 

(4) performance expectations. 

The recent National Commission for Employment Policy 
repon on JTPA Performance Standards (1988) states that "[c]on- 
sistent with the limited Federal role in designing the JTTA 
program, the intention of Federal performance-standards 
policies is to foster accountability and cost-effeaiveness without 
undue influence on SDA design decisions. The Federal perfor- 
mance-standards policies include the choice of measures, me 
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numerical level at which the stOLdards are set, and the provision 
of optional models for adjusting standards." 

The performance standards experience to date in both job 
placement (the U.S. Employment Service-State Employment 
Security Agencies system) and employment and training (JTPA) 
activities offers compelling evidence that introduction of a per- 
formance measurement process can be expected to introduce 
many unintended effects. It is essential that sufficient technical 
assistance and staff training lie made available to minimize 
counter-productive actions that are taken based on 
misunder»tandings about the intent or consequences of the stand- 
Anticipated opposition to the use of wage-records data can be 
defused by demonstrating how it can be used with other com- 
plementary data sources to inform management decisions. 



Complementary Data Sources 



This section relies heavily upon the Florida Placement Infor- 
mation Program, This Program has mergec the following data 
sources: 

(1) vocational student data; 

(2) wage-records data; 

(3) higher education data; 

(4) mlitary service data; 

(5) Federal government civilian employment data; 

(6) U.'i. Postal Service data; and, 

(7) selected occupational information. 

Higher education data are idiosyncratic within each State. It is 
unlikely that a single request to one State-level authority will suf- 
fice. The use of social security numbers as student identifiers is 
ureven among higher education institutions, although there are 
many signals that schools are being urged to provide such infor- 
matioiL 

Currentiy, Florida initiates requests to employers for occupa- 
tional information based on student and wage-record matches. 
Other states (Colorado, Oregon and Utah) have made similar ef- 
forts for different purposes. None of these attempts has achieved 
the status of routine prac^-e. Employers have insufficient incen- 
tive to bear the costs of this out-of-the-ordinary request for in- 
formation, and some express concern about the intrusiveness of 
the practice. I do not expect occupational infortxi' tion to become 
a routine part of State follow-up activities. 
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Merging of Wage-Records Across 
State Boundaries 

There is no reason, in principle, why cross-state matching can- 
not be accomplished. Indeed, it has been done in specific ad hoc 
research applications (Hanna, 1989.) 

Data processing capabilities can be expected to improve, while 
costs continue to falL This means that the potential to conduct 
the types of file searches and mergers that have been described 
in this section will be less of a constraint than the caution and 
skepticism of various parties about the uses to which the data will 
be put 
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Part II 



Process Issues 



Institutional Responsibilities 

This section describes roles and responsibilities at the Federal, 
State and local levels. It is not sufficient to offer compelling 
evidence of hypothetical technical feasibility. If wage-records in- 
formation is to become available for routine application in the 
vocational education community, ±en specific tasks must be ac- 
cepted by individuals and groups to make it happen. 

The Federal role is limited by the State ownership of the wage- 
records data and by the extent of State and local autonomy in 
vocational education administration. Discretionary leadership 
opportunities are available for Federal government action. 

Federal Actions 

Two simultaneous Federal actions should be taken: 

(1) Reauthorization of the Carl D. Perkins Vocational 
Education Act should include language that acknow- 
ledges the current existence and potential routine 
availability of wage-record data, which can be useful in 
managing the Nation's vocational education system: and. 

(2) advantage should be taken of demonstration and re- 
search language that is already in the Act to sponsor care- 
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fully designf -1 demonstrations of the use of the wage- 
records data. 

The U.S. Department of Education has an opportunity to ac- 
cept leadership responsibility in assuring that best-practice State 
and local uses of wage-records information for performance 
measurement purposes are brought to the attention of the entire 
vocational education community. 

It is neither necessary nor advisable to attempt to impose 
uniform practices through Federal legislation or adn[iinistrative 
mandate at this time. Instead, compelling evidence of both tech- 
nical feasibility and practical plication and usefulness should 
be developed involuntary demonstration settings. This informa- 
tion can then be used to encourage voluntary adoption of similar 
procedures in other settings. 

At least one demonstration fiat is imdcrtaken should offer an 
integrated approach covering vocational education, JTPA, public 
labor-exchange, and State sponsored industry-specific training 
programs. The intention here would not be to impose uniform 
performance standards on each of the participating institutional 
players. The objective would be to identify the differences and 
similarities that will be encountered in trying to "rationalize" 
bmnan resources poUdes at the Federal and State levels. In such 
a demonstration great care must be exercised in the initial design 
phase to head off fears that '"apples and oranges" comparisons 
will be made. Such fears contrfljuted to the demise of Arizona's 
use of wage-records, and were raised in an evaluation of JTPA 
programs in Nevada (Hanna, 1987). The respective program ad- 
ministrators must be assured that the external analysts under- 
stand the differences among secondary and postsecondary 
vocational education, industry-specific training, JTPA sponsored 
short-term training, and State Employment Security Agency 
labor-exchange responsibilities. 

At some point in the near future the Department of Defense 
and the Office of Persotmel Management will be required to es- 
tablish administrative procedures for responding to requests for 
information, if widespread use of longimdinal foUow-up systems 
emerges (Pfeiffer, 1989.) The U.S. Department of Labor already 
has a task iOrce working on anticipated policy issues. 



The OfSce of Strategic Planning and PoHcy Development in 
the Employment and Training Administration of the U.S. 
Department of Labor has sponsored three activities during the 
past year that serve as models of what could be done through U.S. 
Department of Education auspices to promote the use of wage- 
records data for consumer information and program evaluation 
purposes: 

(1) A labor market information project produced two 
monographs (Duggan, 1987; Stevens and Duggan, 1988) 
and a wall chart that describes the current status of labor 
market information «5a:a series; 

(2) three regional fonmis elicited the opinions of a wide 
range of labor market information consumers about the 
weaknesses in currently available data; and, 

(3) a national conference brought together most of the in- 
terested constituencies to debate the merits of creating a 
national capability to retrieve and analyze wage-records 
data from all of the States (Northeast-Midwest Institute, 
1989). 

State Actions 

At the State level, accountability concerns will determine 
whether and how legislative action is taken to encourage or re- 
quire adoption of wage-records tracking of vocational program 
leavers. Arizona's experience (Brown and Choy, 1988), and 
Florida's efforts, offer useful insights about the relative merits of 
Statewide mandate versus local discretion. It is unlikely that 
wage-records will suffice as the only source of useful post- 
program information. A threat of Federal mandate in the ab- 
sence of adequate Ctate rest nses will move some States to act. 

The cooperation of secoudary, community college and univer- 
sity systems will be necessary to assemble a truly compreheiisive 
picture of vocational education outcomes. The unique organiza- 
tional relationships and personalities across the States will deter- 
mine how extensive adoption practices will become. 
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Gubernatorial leadership and legislative cooperation will be key 
determinants of success in this regard. 

The fiscal circumstances of the 1990s will favor public accoiint- 
ability, which should offer elected officials some leverage when 
dealing with skeptical and fearful administrators within the voca- 
tional education system. There are good reasons for some of this 
skepticism based on past abuses of the unit-of-analysis issue 
described earlier (Brown and Choy, 1988). 

The States must accept primary responsibility for control of in- 
stimtional and transcript information that will be matched with 
wage-records information for evaluation purposes. Quality con- 
trol considerations require that this responsibility be accepted at 
the State level Substantial cap^ity biiQding will be required to 
enable many States to perform the required tasks. Professional 
associations and the National Governors' Association should be 
used as conduits for much of the interstate sharing of information 
and technical assistance that will be needed. 



Local Actions 

At the local level, which is where the data are generated, lies 
the ultimate responsibility to refine the educational experience 
in light of accurate and relevant information about previous 
smdents'-subsequ'ent labor market, higher education and military 
service experiences. Here, both administrators and school board 
members, as well as irstructional staff persons and technical ad- 
visory groups, must become informed about these experiences. 

This will require consciousness raising activities similar to 
those routinely used in the labor market information user world 
by State Occupat /nal Information Coordinating Committees 
and State Employment Security Agencies. 

Beyond consciousness raising, local school administrators will 
be asked to provide two essential information items: 

(1) individual enrollee sodal security numbers; and, 

(2) transcript information. 
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Currently, not all schools record sodal security numbers on 
permanent student records, and not all students have social 
security numbers. It is unlikely that local school ofGcials can be 
asked to accept quality control responsibilities to assure accurate 
recording of social security number information. 

Routine editing software can be provided to State officials who 
will receive the student information from local schools. This will 
enable the State to detect such simple errors as erroneous digits ~ 
there are certain numbers that are never used in p?rts of the nine- 
digit field, and numbers that are inconsistent with the age of the 
student 

An "all or nothing" approach should be discouraged at the out- 
set Local school districts, and individual institutions within each 
district, have diifferent administrative capabilities to respond to 
external mandates for information. It is essential that these local 
professionals be convinced that the informatioii will actually be 
used and that they will receive the results. 



Cost Estimates 

Detailed information has been collected from selected State 
Employment Security Agencies by James Hanna, Chief of 
Research for the Nevada Employment Security Departmem 
(Hanna, 1989). Based on this information Hanna estimates that 
the per wage-record cost of obtaining quanerly information 
would be S.003 (i.e., three-tenths of one cent per update). This 
would include matching within the State Employment Security 
Agency to provide the employer identifiers described earlier, as 
well as the individual earnings information. 

This estimate is subject to many qualifiers, since each of the 
responding States used a different set of criteria in producing an 
estimate, based on their own unique cost accounting practices 
(e.g., how computer time is charged). 

Assuming a national universe of 100 million wage records, each 
quarterly update would cost approximately 5300,000, or 
51,200,000 annually. This assumes that four separate updates 
would be conducted. 
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Obviously, the number of vocational education program 
leavers annually is a small fraction of the 100 million figure that 
was used above, so vocational education's share of any collabora- 
tive updating (eg., on behalf of vocational education, JTPA, and 
State funded industry-specific training programs) would be ap- 
propriately charged. 

This cost estimate is to bring the wage-records data together 
in one place; or, to make it available through a distributed net- 
work access capability. Analytical charges wotild be added to this 
figure. A substantial part of the analytical costs would be a one- 
time investment to produce appropriate software to generate the 
types of tabulations and graphics that are desired for evaluation 
and consumer information purposes. The Federal government is 
the proper bearer of the costs to create a set of "core-products", 
which could then be complemented through individual State in- 
vestments in bells and whistles. 

No reference has been made in the previous text to the costs 
that would be incurred by local school districts and by the States 
to create a capacity for matching of school records with wage- 
records information. These costs will vary tremendously, 
depending upon the extent of automation and current reporting 
that is required. 

An important task in the scope-of-work for early demonstra- 
tion is to generate credible cost estimates for each of the institu- 
tional players. There is no reason why both the process and 
technical matters caimot be explored in a demonstration setting 
over a one- to two-year period, starting in FY 1990. Several 
States are anxious to cooperate in such a demonstration. 



Legal Considerations 

Interpretation of the Buckley Amendment regarding the 
release of student records, and interpretation of each State's 
employment security confidentiahty provisions, are the key legaJ 
issues to be resolved. There are many examples of successful 
compliance with both. There is no reason why either should be- 
come an insurmountable barrier to use of the wage-records ap- 
proach. 
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The smaller the proposed, or possible, unit of analysis the 
greater will be the risk of unacceptable disclosure. It might ap- 
pear that male-female employment and earnings comparisons 
among leavers from a single institution poses no rislc, but this is 
not the case if only one member of either sex is found in the 
chosen population. 

A practical solution to many of the disclosure concerns is to 
?dopt at the outset a set of uniform standards similar to those of 
the Bureau of Labor Statistics. The Bureau follows longstanding 
rules of minimum cell sizes that will be published. Software can 
be written to carry out whatever limits are agreed upon. 

Another way to assure the States that inappropriate use will not 
be made of their wage-records data is to draw samples from 
designated populations (e.g., vocational education program 
leavers) who will then be tracked nationally on a routine basis, 
while other ad hoc requests for wage-records data are directed 
to the individual States. A distributed network capability would 
permit both objectives to be achieved. Each State would retain 
physical control of its own wage-records information, but it would 
agree to create and maintain an archive of the wage-records in- 
formation, so unanticipated future uses of the data could be ac- 
comodated. The major weakness in draviang a sample at one 
point in time, and then tracking this population longitudinaUy, is 
that unforeseen needs for information may not be consistent with 
the original sampling criteria (e.g., wanting to understand the dis- 
persion of employed Nicaraguan refugees from points of arrival 
to other places in the United States). 

Tension has already arisen among three interest groups: 

(1) The State Employment Security Agencies and the 
Federal Unemployment Insurance Service, whose com- 
mon interest is to protea the primary administrative uses 
of the data; 

(2) the Congress, which has already enacted legislation 
mandating the use of the data for enforcement purposes 
in conjunction with Federal housing subsidies and food 
stamps eligibility determination; and, 
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(3) the policy analysis community, who see the potential 
of the data for conducting cost-effective studies of a wide 
range of policy issues. 

It is imperative that the States be included in future delibera- 
tions that affect their administrative responsibilities. The Inter- 
state Conference of Employment Security Agencies is an 
appropriate representative of State interests. 

There is no reason why the States' legitimate concerns cannot 
be accomodated, while still managing to achieve most of the 
policy analysis purposes that ai e sought The contentious debate 
over enforcement uses of the data is another matter. There is a 
very real danger that these proposed uses will substantially delay, 
and perhaps even scuttle, other requests for access to the wage- 
records. 

At a mini uum, demonstrations that can be conduaed in full 
compliance with current statutory requirements should not be 
delayed. The insights they provide will ultimately be the deter- 
mining factor in decisions about whether to proceed with more 
expensive data retention and analysis activities. 
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Conclusions and Recommendations 

for Action 

Endorsement by the Vocational Education 
Community 

Substantial interest is being exhibited in many quarters about 
the potential uses to which wage-records information can be put. 
The vocational education community is one important interest 
group among many. Congress has already shown a willingness to 
mandate use of these data for purposes unrelated to vocational 
education's interests. For both offensive and defensive purposes 
it is timely for vocational educators to take an aggressive posmre 
with respect to acceptance of these data as one source of useful 
information to guide administrative and consumer decisions in 
the future. 

Demonstration Projects 

If demonstration projects are undertaken in FY 1990, then 
within two years enough technical and process issues will have 
been resolved to suppon decisions about the merits of adopting 
refined accountability procedures on a nationwide basis. This 
does not necessarily mean that a top-down approach is inevitable. 
It does mean that only the Federal goverament is likely to accept 
the responsibility for funding demonstrations that can answer the 
questions that need to be addressed before skeptics can be shown 
compelling evidence of what will and what will not be feasible. 
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rechnical Assistance and Other Capacity Building 

Today, the States are arrayed along a continuuni of capacity 10 
move quickly to incorporate wage-records accountability proce- 
dures into their vocational education systems. Florida is the 
leader in many respects. Missouri has demonstrated both inter- 
est and institutional capacity, but has not made a commitment to 
sustained support Many other States have expressed curiosity, 
and some have taken tentative steps to introduce use of the wage- 
records information into their accountability procedures. 

Realistically, it is likely to be five years before widespread 
routine adninistrative uses of the wage-records data for voca- 
tional education follow-up purposes are observed. This is both 
a strength and a weakness. The strength is that there is adequate 
time to work out ghches in alternative approaches and tc invest 
in capacity building in the States to assure appropriate use of the 
data when they do become available. The wjakncss is that iner- 
tia is lost when the prospect of such a long delay in adoption is 
anticipated. 



Support of Immediate Discretionary Actions by the 
States 

There is no reason why discretionary State uses of the data 
should not be encouraged immediately. A small Federal invest- 
ment in capacity building now should offer a handsome payoff 
during the 1990s. Appropriation of $3-5 million for demonstra- 
tion and technical iissi^tancc purposes during FY 199 1 should fol- 
low a more modest commitment of perhaps $750,000 during FY 
1990 to take advantage of State expressions of interest in begin- 
ning immediately to build the bridges among Federal and State 
human resources programs that will be necessary to design a cost- 
effective integrated accountability system. 

Again, it is not anticipated that a single Federal system will 
serve all States equally well. Instead, it is expected that a Federal- 
ly funded core design would be made available to the States for 
disCTetionary adoption and refinement. 
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A Consumer Information Focus at the Outset 

It is essential that the wage-records approach begm with a 
heavy consumer information focus (le^ well designed formats 
with appropriate graphics) that is not viewed as a basis for im- 
mediate performance-based contracting applications. This will 
permit the various interest groups to reveal their enthusiasm and 
concerns, which will in turn permit the system designers to make 
appropriate modifications that might be needed. The unit of 
analysis choices that are made at the outset will set the tone for 
the entire undertaking. Initial selection of more encompassing 
classifications will be seen as less of a threat by incumbent staff 
members. 



Public- and Private-Sector Coverage 

In most States initial information will be limited to those who 
have left public-sector instimtions, because there will be no 
routine way to secure sodal security numbers for those who en- 
roll in proprietary programs. An early step in resolving technical 
issues must be to crtate an accurate inventory of State regulatory 
practices with respect to for-profit providers of occupational 
skills tr ainin g- 



A Work Group to Identify Complementary Data Items 

A second early step to be taken at the Federal level will be to 
identify specific data items that might be matched with the wage- 
records information. It is not enough to simply recommend 
generic classifications of data, such as "transcript information." 
The objective must be to assure quality control over a minimum 
core of items that will be sufficient to offer useful administrative 
and consumer information (i.e., items that will help to support 
the publication of "actionable" information). 
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A U.S. Department of Education Task Foice 

An immediate step that can be taken at very little expense is to 
form a U.S. Department of Education task force, similar to that 
recently formed by the U.S. Department of Labor, to address 
specific wage-records topics that are of urgent interest to the 
education commimity as a whole — not just the vocational educa- 
tion community. Such a working group could accomplish two im- 
portant next steps: 

(1) prepare a list of education program appUcations that 
could be made using wage-records data, and establish 
priorities for these applications (e.g., student loan 
program evaluations, and employment mobility patterns 
of employees in "shortage" occupations); and, 

(2) mock-Hip reporting formats that would serve specific 
users (e.g^ members of Congress; governors; State legis- 
lators; school board members; State and local ad- 
ministrators; and prospective students, their parents and 
school counselors.) There is a sufficient pool of ex- 
perienced users to date to assist in this activity. 

Both of these activities should be seen as supportive of the 
preparation of a promotional package. The use of wage-records 
is appeahng to many parties, in principle, but there is a well- 
deserved attitude of caution based on the false-starts that have 
been undertaken in the past to collect data for e valuation and con- 
sumer information purposes. When these individuals can be 
shown actual products that will result from their endorsement 
they are more likely to be enthusiastic supporters. 
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Yesterday, Today and Tomorrow 



When this paper was conmiissioned there was a sense of an- 
tidpatioii by National Assessment of Vocational Education staff 
members that the wage-records data source might offer some 
promise of responding to expressions of frustration by various ex- 
ternal overseers about their inability to learn much about voca- 
tional education outcomes. 

Since then, two national forums have been held to explore per- 
formance measurement issues (Northeast-Midwest Institute, 
1989; Office of Technology Assessment, 1989). This paper 
reflects the proceedings at both of these conferences. 

Sufficient interest has been shown by mt^jbers of Congress 
that some legislative action might occur during the current ses- 
sion. Those who a year ago said **no way^ now acknowledge that 
the availability of wage-records information is only a matter of 
when, through what auspices, for what purposes. 

This paper offers the vocational education community a primer 
on how to become Involved In what promises to be a rapidly 
moving process. 
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